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Abstract — The capacity of discrete-time, non-coherent, multi- 
path fading channels is considered. It is shown that if the delay 
spread is large in the sense that the variances of the path gains 
do not decay faster than geometrically, then capacity is bounded 
in the signal-to-noise ratio. 

I. Introduction 

This paper studies non-coherent multipath (frequency- 
selective) fading channels. Such channels have been inves- 
tigated extensively in the wideband regime where the signal- 
to-noise ratio (SNR) is typically small, and it was shown that 
in the limit as the available bandwidth tends to infinity the 
capacity of the fading channel is the same as the capacity of 
the additive white Gaussian noise (AWGN) channel of equal 
received power, see [1]Q 

When the SNR is large we encounter a different situation. 
Indeed, it has been shown in [5] for non-coherent frequency- 
flat fading channels that if the fading process is regular in 
the sense that the present fading cannot be predicted perfectly 
from its past, then at high SNR capacity only increases double- 
logarithmically in the SNR. This is in stark contrast to the 
logarithmic growth of the AWGN capacity. See [6], [7], [8], 
and [9] for extensions to multi-antenna systems, and see [10] 
and [11] for extensions to non-regular fading, i.e., when the 
present fading can be predicted perfectly from its past. Thus, 
communicating over non-coherent flat-fading channels at high 
SNR is power inefficient. 

In this paper, we show that communicating over non- 
coherent multipath fading channels at high SNR is not merely 
power inefficient, but even worse: if the delay spread is large 
in the sense that the variances of the path gains do not decay 
faster than geometrically, then capacity is bounded in the SNR. 
For such channels, capacity does not tend to infinity as the 
SNR tends to infinity. To state this result precisely we begin 
with a mathematical description of the channel model. 

A. Channel Model 

Let C and Z + denote the set of complex numbers and the 
set of positive integers, respectively. We consider a discrete- 
time multipath fading channel whose channel output Y k E 
C at time k e Z + corresponding to the channel inputs 

'However, in contrast to the infinite bandwidth capacity of the AWGN 
channel where the conditions on the capacity achieving input distribution 
are not so stringent, the infinite bandwidth capacity of non-coherent fading 
channels can only be achieved by signaling schemes which are "peaky"; see 
also [2], [3], [4] and references therein. 



6 C fe is given by 



Y k 



(1) 



(i) 

Here, H k denotes the time-fc gain of the ^-th path, and 
{Z k } is a sequence of independent and identically distributed 
(IID), zero-mean, variance-er 2 , circularly-symmetric, complex 
Gaussian random variables. We assume that for each path 
i G Iiq (with Zq denoting the set of non-negative integers) the 
stochastic process {H^\k 6 Z + } is a zero-mean stationary 
process. We denote its variance and its differential entropy rate 

by 



at 



H 



Ml 2 



and 



hp = lim 



n V 



respectively. We further assume that 



sup ae < oo 



and 



inf he > 

tec 



(2) 



where the set C is defined as C = {£ £ Zjj" : ag > 0}. We 
finally assume that the processes 

{Hi°\keZ+},{H£\keZ+},... 

are independent ("uncorrected scattering"), that they are 
jointly independent of {Zk], and that the joint law of 

({Z k } 1 {H { k °\kEZ + },{Hi 1 \ke2, + },...) 

does not depend on the input sequence {x k }. We consider a 
non-coherent channel model where neither the transmitter nor 
the receiver is cognizant of the realization of {H k e \ k G Z + }, 
I E Zj, but both are aware of their statistic. We do not assume 
that the path gains are Gaussian. 

B. Channel Capacity 

Let A™ t denote the sequence A Ti 
the capacity as 



, A n . We define 



1 



C(SNR) ± lim -sup7(Xf;F 1 n ) 



(3) 



where the maximization is over all joint distributions on 
Xi, X2, ■ ■ ■ , X n satisfying the power constraint 



±±E[\X k \*]<F, 



(4) 



k=l 



and where SNR is defined as 



SNR 



P 



(5) 



By Fano's inequality, no rate above C(SNR) is achievable^ 
(See [13] for a definition of an achievable rate.) 

Notice that the above channel (HJ is generally not stationary 
since the number of terms (paths) influencing Y k depends on 
k. It is therefore prima facie not clear whether the liminf on 
the RHS of © is a limit. 

C. Main Result 

Theorem 1: Consider the above channel model. Then 



lim ^±i>0 



sup C*(SNR) < oo 

SNR>0 



(6) 



where we define, for any a > 0, a/0 = oo and 0/0 = 0. 

For example, when {ae} is a geometric sequence, i.e., oti = 
p , I £ Zq for some < p < 1, then capacity is bounded. 

Theorem \T\ is proved in Section [TT] where it is even shown 
that I© would continue to hold if we replaced the liminf in (0 
by a limsup. Section [III] addresses briefly multipath channels 
of unbounded capacity. 

II. Proof of Theorem[T| 

The proof follows along the same lines as the proof of [14, 
Thm. li)]. 

We first note that it follows from the left-hand side (LHS) 
of © that we can find an £q & "^o anc ' a < p < 1 so that 

ap n > and 



,4 + 1,. 



(7) 



We continue with the chain rule for mutual information 



k=l 

n 



(8) 



k=£ + l 



Each term in the first sum on the right-hand side (RHS) of ([H) 
is upper bounded bj@ 

l(X?;Y k \Y*- 1 ) 

< h{Y k ) - h(Y k \Y*- x 

< log (ne (a 2 + ^ a k - ( E [\X e \ 2 ] 



yn o-(0) tt(1) 



rr(fe-i; 



- log (7 



< log 1 + sup ae ■ n ■ SNR 



(9) 



where the first inequality follows because conditioning cannot 
increase entropy; the second inequality follows from the 

2 See [12] for conditions that guarantee that C(SNR) is achievable. 
3 By a stationary channel we mean a channel where for any stationary input 
{Xfr} the pair {(Xk,Y k )} is jointly stationary. 

4 Throughout this paper, log(-) denotes the natural logarithm function. 



entropy maximizing property of Gaussian random variables 
[13, Thm. 9.6.5]; and the last inequality follows by upper 
bounding ae < sup fgZ + ae, £ = 0, 1, . . . , k — 1 and from 
the power constraint ||4). 

For k — £q + l,£o + 2, ...,n, we upper bound 
/(Xf; Yfc J Y^ -1 ) using the general upper bound for mutual 
information [5, Thm. 5.1] 



I(X;Y) < / D(W(-\x)\\R(-))dQ(x), 



(10) 



where D('ll') denotes relative entropy, W(-|-) is the channel 
law, Q(-) denotes the distribution on the channel input X, 
and R(-) is any distribution on the output alphabetic Thus, 
any choice of output distribution R(-) yields an upper bound 
on the mutual information. 



For any given Y{ 



k-l 



distribution R(-) to be of density 

V? 1 
^\ V k\i + W 

with ,9= l/0\y k _ io \ 2 ) ancg 

Olio 



we choose the output 



Vk £ C, 



(3 = min < p ° 



-,ott ,p 



(11) 



(12) 



<iE[log|r fc | 2 ] + iE 



££Z+. 



(13) 



maxo<<'<; ae> 

With this choice 

< < 1 and [3ae < ctt+t al 
Using (fTTb in ( [Tot , and averaging over Y^ 1 , we obtain 

/(x^nlK*- 1 ) 

[log^ir^j 2 )" 

log (P\Y k -e \ 2 + \Y k \ 2 )} - h^X^.Y*- 1 ) 

(14) 

We bound the terms in ( fT~4T > separately. We begin with 

E[log|y fe | 2 ] =E[E[log|r fc | 2 | X*]] 
<E[log(E[|r fe | 2 |X 1 fe ])] 



E[io g |r fc _, | 2 ] +\o g j 



log(<j 2 + J2 a k-e\Xe\ 



(15) 



where the inequality follows from Jensen's inequality. Like- 
wise, we use Jensen's inequality and ( fT3l to upper bound 



log (P\Y k ^ \ 



< E 



< E 



k-to 



log \pcj 2 +pY, ctk-to-tlXtf 



(=1 



k-e 



log cr 2 + E a k-t\ x e 



(16) 



5 For channels with finite input and output alphabets this inequality follows 
by Tops0e's identity [15]; see also [16, Thm. 3.4]. 

6 When yk—i = 0, then the density of the Cauchy distribution (TTJ is 
undefined. However, this event is of zero probability and has therefore no 
impact on the mutual information / (^™ ; Yk I Y\ ~ 1 ) ■ 



and 



log (m 



k-f'a 



< E 



log 2a 2 



-ini s 

k-l 

2 a k -i\Xt 



k 



< log 2 + E 



log (cr 2 +^a fc _^|X 



|2 



(17) 



where the second inequality follows because 

Next, we derive a lower bound on /i(Yfe|jf™,Yj Let 
H fc , = {H$\H%\ H^ 1] ), k' = 1,2, . . . , k - 1. We 
have 



fc-i 

fc-lN 



(18) 



where the inequality follows because conditioning cannot 
increase entropy, and where the equality follows because, 
conditional on (X™,!!^ 1 ), Y k is independent of Y*~ l . Let 
St be defined as 



1,2, 



, : min{|x£| 2 , > 0}. 



(19) 



Using the entropy power inequality [13, Thm. 16.6.3], and 
using that the processes 

{< ) ,fceZ+},K 1) ,£ ;G Z+},... 

are independent and jointly independent of X[ L , it can be 
shown that for any given Jf™ = x™ 



' k 

H H k 

,1=1 



(k-t) 



>io g ( 

\ees k 



Xi + Z k 



X[ l 



fc-i 



+ e 



(20) 



We lower bound the differential entropies on the RHS of ( 1201 
as follows. The differential entropies in the sum are lower 
bounded by 



h H 



{k-t) 



X ( 



k 

log (a fc _,N 2 ) + h(Ht l) | {^}t=i) " loga^ 



> log (a k - e \x e \ 2 ) + inf (he - \oga e ) , 



I G 5 t , (21) 



where the equality follows from the behavior of differential 
entropy under scaling; and where the inequality follows by 
the stationarity of the process {H^ k e \k e Z + } which 

implies that the differential entropy h(H^ k ~^ | {Hy~^ j^,^) 
cannot be smaller than the differential entropy rate hk-t 
[13, Thms. 4.2.1 & 4.2.2], and by lower bounding (h k -i — 
log afc-f) by mii(zc(hi — loga^ ) (which holds for each £ 6 
because <Sfc C £). The last differential entropy on the RHS of 
is lower bounded by 



h(Z k ) > mf (hi - logoti) + \oga , 



(22) 



which follows by noting that 



inf (hi — logae) < log(7re) 



(23) 



Applying <|2T) & d22j to ®, and averaging over X", yields 
then 



h(Y k \X?,Y«- 1 ) > E 



log a 2 + ^2a k -e\X e 



inf (he — log< 

lec 



(24) 



We continue with the analysis of (fT~4-b by lower bounding 
E [log | Yfc_£ 1 2 ] . To this end, we write the expectation as 



log 



k-in 



k-t a 



and lower bound the conditional expectation by 

2 



log 



fc-Aj 



(k-io-e 

k-in 



k-in 



Xi + Zk-K 



X 



k-l Q 



k-in 



log cr 2 + E 



«=1 



2- E 



log 



e= i ti k -i Xi + Z k ~e 



o 2 + J2e=i° a k-e -i\xe.\ 2 



k-e 



>log \a 2 + a k -e -i\xi\ 2 j + log 5 2 - 2e(S, rj) 

f sr^k-lo (k-lo-l) y 

2^_ E^i H k _ l0 Xl + Z k ^ ( (25j 

^ V V* 2 + ££N*-*.-*M 2 

for some < 5 < 1 and < r\ < 1, where 



fc _ (X)= / fx(x)\ogfx(x)dx, (26) 

J{^eC:/x(a;)>l} 

and where e(S, ry) > tends to zero as 5 J. 0. 
(We write x<> in lower case to indicate that expectation 
and entropy are conditional on X k ~ = x^ - ^ .) Here, 
the inequality follows by writing the expectation in the 
form Eflogl^- 1 ■ I{\A\ > 6}] + E[log|A| _1 • I{\A\ < 5}] 
(where /{■} denotes the indicator function), and by upper 
bounding then the first expectation by — log S and the second 
expectation using [5, Lemma 6.7]. We continue by upper 
bounding 

\^k-e rr(k-e -i) y 
1^ 1=1 H k-i a X i + Z k-i 

0-2 + J2e=i° a k -e -i\xe\ 2 

t=l H k-i Xe + Z k - 



= h- 



cr 2 + YliJi ot k -e -t\xe\ 



t=i H k-e 'xi + Zk-tp 

° 2 + Y^t=\ ak-lo-l\ x t? 
2 / k-e 

<- + log(Tre) + log cr 2 + ^ a k-l -Mi f 



/ k-i 
log a 2 + a k ~i -e\X e \< 

2 (2 



e=i 



'k-l a 



ME^ 



(k-t -i) 
k-lo 



%i + Zk-i 



(27) 



where h+(X) is defined as h+(X) = h(X) + h~(X). Here, 
we applied [5, Lemma 6.4] to upper bound 

-k-lo rj-(fc-<o-*). 



: < - +log(7re). (28) 

o 2 + Y!tZi ] a k -e -e\xe\ 2 



h+ 

\^ 2 + Ee=i 
Averaging d27l i over A^~ <0 yields 

t=i H k-i X e + Z k _ go 



o* + YZZi<*k-to-t\Xi\ s 



x*~ e ° 



<- + log(Tre) + E 



log a 2 + ak-l -e\Xif 



< - + log(7re) - inf (h e - log a e ) , 



fc-fo 



(29) 



where the second inequality follows by conditioning the dif- 
ferential entropy additionally on y^ 1 "^ 1 , and by using then 
lower bound d24l >. A lower bound on E [log | Yfc_£ 1 2 ] follows 
now by averaging (|25| ) over Xf 5 °, and by applying 



E [log|F fc . 



> E 



log [a 2 + otk-to-tlXtf 



2 (2 



+ log S 2 - 2e(5, rj) + log(7re 



+ inf — (he — log at) 



(30) 



Returning to the analysis of ( TBI , we obtain from ( f3Qb . ( l24l i. 
{£3, GD, and O 



/(xf^fely^- 1 ) 

log cr 2 + ^a fc _^ 



<Ie 

- 2 



log cr 2 + J! "fc-d^ 



log 2 + E 



log cr 2 +^2a k - e \X e 



log |V 2 +^a fc _,|X,| 2 ^ 



inf (/^ - logoff) 



< 



- logcT + 2e(5, + + log(Tre) 

2 7T 2 

" ] n f -(^- lo S^)+ lo g J 
K + E log (^a 2 +J2a k _ e \X e \^j 

log [cr 2 +^2 a k-£ -i\Xi\ 2 



(31) 



with 



e=i 



K = — inf ( 1 + - ) - log a,) + log J- 

<?e£ V V/ PS 2 

+ 2e(S,r]) + - [ - + log(7re) 



(32) 



The second inequality in OTb follows because 
YHZI a k ^\X e \ 2 < Y!l =1 a k -i\X t \ 2 . 

In order to show that the capacity is bounded in the SNR, we 
apply OTb and (O to ([HJ and use then that for any sequences 
{a k } and {b k } 



^ (a k ~h)= ( a k - h-n+2i ) 

k=i +l k =n-£ + l 

n—to 

+ (a k -h+e )- 
k=e +i 



(33) 



Defining 



a k = t 



log (a 2 +Y,ak-i\X e \ 2 



i=i 



and 



b fc ^E 



log [a 2 + a k -e -e\Xe\' 



(34) 



(35) 



we have for the first sum on the RHS of (l33l 



fc=n-£ + l 



E e 

k =n-l +l 



log 



o- 2 + Z)<=i <*k-t\Xt 



9 I v-^vfc— n+£o 



< £ Q log 1 + sup at ■ n ■ SNR , 

V i&t J 



(36) 



which follows by lower bounding the denominator by a 2 , and 
by using then Jensen's inequality along with the last inequality 



in (|9]l. For the second sum on the RHS of (|33l we have 



E 



= E ' 

fc=£o + l 

= 0. 



log 



g 2 + Z)i=i QLk-e\Xe 
o 2 + YjI=i a k-e\Xg 



(37) 



Thus, applying ([3TJ — d3Vl> and © to ©, we obtain 
1 



< — log 

n 



sup ai ■ n ■ SNR 



log 



sup i 



■ n • SNR 



n - 2£n 



K) (38) 



which tends to K < oo as n tends to infinity. This proves 
Theorem [T] 

III. Multipath Channels of Unbounded Capacity 

We have seen in Theorem Q] that if the variances of the path 
gains {ai} do not decay faster than geometrically, then ca- 
pacity is bounded in the SNR. In this section, we demonstrate 
that this need not be the case when the variances of the path 
gains decay faster than geometrically. The following theorem 
presents a sufficient condition for the capacity C(SNR) to be 
unbounded in the SNR. 

Theorem 2: Consider the above channel model. Then 



lim — log log — = oo 

»— >oo I Oil 



(39) 



sup C(SNR) = oo | 

VSNR>0 

Proof: Omitted. ■ 
Note: We do not claim that C(SNR) is achievable. How- 
ever, it can be shown that when, for example, the processes 
are IID Gaussian, then the maximum 
achievable rate is unbounded in the SNR, i.e., any rate is 
achievable for sufficiently large SNR. 

Certainly, the condition on the LHS of ( [391 is satisfied when 
the channel has finite memory in the sense that for some finite 
L e Z+ 

a e = 0, I = L 



In this case, (fTJ becomes 



Y, = { 



( fe-i 

L 



(0 



Xk-t + Z k: 



1,2, 



,L 



(40) 



hi 'x^t + z k , 

1=0 



L + 1,L- 



This channel d40b was studied for general (but finite) L in 
[17] where it was shown that its capacity satisfies 

C(SNR) 



lim 



(41) 



SNR^oo log log SNR 

Thus, for finite L, the capacity pre-loglog (ETl i is not affected 
by the multipath behavior. This is perhaps surprising as 
Theorem Q] implies that if L = oo, and if the variances of 
the path gains do not decay faster than geometrically, then the 
pre-loglog is zero. 
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